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(54) TiUe: IMAGE SUBREGION QUERYING USING COLOR CORRELOGRAMS 
(57) Abstract 

A color correlogram (110) is a lepresoitation expressing the spatial 
I comelanon of color and distance between pixels in a stored image. The color i on 

correlo^m may be used to distinguish objects in an hnage as well as between " 
I images in a Plurality of images. By intersecting a color coirelogram of an 
image object (115) widi conelograms of images to be searched (100) those 
im^es which contain the objects are identified by the intersection coirel'ogiam 
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IMAGE SUBREGION QUERYING USING COLOR CORRELOGRAMS 

CROSS REFERENCE TO RELATED APPLICATIONS 
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present applicants, and Serial No. 60/089,684, entitled "Image 
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application Serial No. , entitled, "Image 

Indexing Using Color Correlograms " by the present applicants. 
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BACKGROUND OF THE INVENTION 
This invention relates generally to data management, and, 

25 more particularly to retrieving specific portions of images 
using color correlograms • 

With the rapid proliferation of the Internet and the 
World-wide Web, the amoxint of digital image data accessible to 
users has grown enormously. Image databases are becoming 

30 larger and more widespread, and there is a growing need for 
effective and efficient image retrieval systems. Image 
retrieval systems are systems that extract from a large 
collection of images ones that are "similar" to an image of 
interest to the user. Most existing image retrieval systems 

35 adopt the following two-step approach to search image 

databases: (i) indexing: for each image in the database, a 
feature vector capturing certain essential properties of the 
image is computed and stored in a featurebase, and (ii) 
searching: given a query image, its feature vector is 
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coiigjuted. coirpared to the feature vectors in the featurebase, 
and images most similar to the query image are retxirned 1k> the 
user. 

For a retrieval system to be successful, the feature 
defined for an image should have certain desirable qualities: 

(i) the difference between pre-selected features of two images 
should be large if and only if the images are not "similar", 

(ii) the feature should be fast to confute, and (iii) the size 
of the feature should be small. 

While most image retrieval systems retrieve images based 
on overall image comparison, users are typically interested in 
target searching such as in a database of images or in video 
browsing. In target searching, the user specifies a subregion 
(usually an interesting object) of an image as a query. For 
example, a user might wish to find pictures in which a given 
object appears, or scenes in a video with a given appearance 
of a person. In response to the user's query, the system 
should then retrieve images containing this subregion, or 
object from the database. This task, called image subregion 
querying, is made challenging by the wide variety of effects, 
such as different viewing positions, camera noise and 
variation, and object occlusion, that cause the same object to 
have a different appearance in different images. 

Color histograms are commonly used as feature vectors for 
image retrieval and for detecting cuts in video processing 
because histograms are efficient to compute and insensitive to 
camera motions. Histograms are not robust to local changes in 
images, so false positives easily occur using histograms. 
Though the histogram is easy to compute and seemingly 
effective, it is liable to cause false positive matches, 
especially where databases are large, and is not robust to 
large appearance changes. Another disadvantage of the color 
histogram is insensitivity to illiunination changes. Recently, 
several approaches have attempted to improve upon the 
35 histogram by incorporating spatial information with color. 

Many of these methods are still iinable to handle large changes 
in appearance. For instance, the color coherence vector (CCV) 
method uses the image feature (s), e.g. spatial coherence of 
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colors and pixel position, to refine the histogram. These 
additional features improve performance, but also require 
increased storage cuid computation time . 

The image subregion retrieval system should also be able 
5 to solve the location problem, i.e. the system should be able 
to find the location of the object in the image. The location 
problem arises in tasks such as real-time object tracking andi 
video searching, where.it is necessary to localize the 
position of an object in a sequence of frames. 

10 Template matching is one approach used to solve the 

location problem. This method generally yields good results 
but is computationally expensive. A refined form of template 
matching is the histogram backprojection method- The method 
of histogram backprojection is to first compute a "goodness 

15 value" for each pixel in an image (the goodness of each pixel 
is the likelihood that this pixel is in the target) and then 
to obtain the subimage and therefore the location whose pixels 
have the highest goodness values. Histogram backprojection 
however gives the same goodness value to all pixels of the 

20 . same color. The technique emphasizes colors that appear 

frequently in the image. This may result in overemphasizing 
certain colors in the object Q. If the image has a subimage 
that has many pixels of color c, then this method tends to 
identify Q with this subimage, even though the two objects may 

25 be unrelated, thus causing an error in some cases. 

Another task requiring object retrieval from images is 
cut detection in video processing. Cut detection is the 
process of segmenting a video into different camera shots 
which allows the extraction of key frames for video parsing 

30 and querying. 

A flexible tool for browsing video databases should also 
provide users with the capability to place object-level 
queries that have semantic content, such as "track this person 
in a sequence of video". To handle to queries, the system has 

35 to find which frames contain the specific object or person, 
and has to locate the object in those frames. 

It remains desirable to have an efficient and accurate 
means of identifying and retrieving objects in images which 
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allows for changes in the appearance of the image content such 
as viewing angle and magnification. 

It is therefore an object of the present invention to 
provide a method and apparatus to perform efficient image 
comparisons in order to retrieve objects in images. 

It is a further object of the present invention to 
provide a method and apparatus to provide to perform image 
comparisons for image subregion querying which allow for 
significant changes in the image such as viewing position^ 
background, and focus. 

It is another object of the present invention to provide 
a method and apparatus which enables efficient image subregion 
retrieval from a database. 

SUMMARY OF THE INVENTION 

The objects set forth above as well as further and other 
objects and advantages of the present invention are achieved 
by the embodiments of the invention described hereinbelow. 

The problems of image retrieval are solved by the present 
invention of providing and using a color correlogreun to query 
objects in images. The color correlogram of the present 
invention is a three-dimensional representation indexed by 
color and distance between pixels which egresses how the 
spatial correlation of color changes with distance in a stored 
image. The color correlogram includes spatial correlation of 
colors, combines both the global and local distributions of 
colors, is easy to compute, and is small from a data storage 
perspective. The color correlogram is robust in tolerating 
large changes in the appearance of a scene caused by changes 
in viewing positions, changes in the background scene, partial 
occlusions, and magnification that causes radical changes in 
shape . 

To create a color correlogram, the colors in the image 
are quantized into m color values, c^ ... c„. Also, the distance 

values to be used in the correlogram are determined 

where [d] is the set of distances between pixels in the image. 
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and where dmax is the maximum distance measurement between 
pixels in the image. Each entry in the color correlogram is 
the probability of finding a pixel of color c^ at a selected 
distance Jc from a pixel of color c^. 

A color autocorrelogram, as provided in this invention, 
is a restricted version of the color correlogram that 
considers color pairs of the form (i,i) only. 

The color correlogram may be used to query objects in 
images as well as entire images stored in a database. 
Extensions to the color correlogram may also be used in object 
retrieval tasks. The general theme behind the extensions are 
the improvement of storage efficiency of the correlogram 
without compromising the image discrimination capability of 
the correlogram and the use of additional information (such as 
an edge) to further refine the correlogram which improves 
image retrieval performance. 

The correlogram intersection is used for image subregion 
querying. Using the correlogram intersection, the relative 
counts of color pairs in the images being compared are 
determined. The comparison easily eliminates the images which 
do not match. 

The correlogram may also be used in locating objects in 
images. The location problem arises in tasks such as real- 
time object tracking or video searching, where it is necessary 
to localize the position of an object in a sequence of frames. 
Efficiency is also required in location because large amounts 
of data must be processed. 

Any norm for comparing vectors, for example the standard 
norm, may be used to compare color correlograms /color 
autocorrelograms . 

Experimental evidence shows that the color correlogram 
outperforms not only color histograms but also more recent 
histogram refinements such as the color coherence vector 
method for image indexing and retrieval. 

The present invention together with the above and other 
advantages may best be understood from the following detailed 
description of the embodiments of the invention illustrated in 
the drawings, wherein: 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a graphic representation of a color 
correlbgram according to principles of the inventions- 
Figure 2 is an image J; 

Figure 3 is a graphical representation of a plurality of 
autocorrelograms according to principles of the present 
invention; and. 

Figure 4 is a flow chart of the process of retrieving 
from a database images matching a query image using the color 
correlogram according to principles of the present invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Figure 1 illustrates a graphic representation of the 
color correlogram 10 of the present invention. The color 
correlogram 10 is a three-dimensional table indexed by color 
value i, color value j, and by distance k between pixels in an 
image. The color correlogram 10 expresses how the spatial 
correlation of color changes with distance in the image. 

The spatial correlation of color in a particular image is 
a feature which may be used to distinguish the image from 
other images. Putting the spatial correlation of colors data 
into the format of the color correlogram creates a data object 
associated with the image which may be stored in a database 
and queried. The color correlogram embodies color 
cheuracteri sties of an image in a way which distinguishes the 
image from other images while tolerating large changes in 
appearance of the image content due to changes in, but not 
limited to, viewing positions, changes in the background 
scene, partial occlusions, and camera zoom that causes radical 
changes in shape. In sum, the color correlogram of the 
present invention includes spatial correlation of colors, 
combines both the global and local distributions of colors, is 
easy to compute, and is small from a data storage perspective. 

To create a color correlogram as defined in this 
invention, the colors in the image are cjuantized into m color 
values, c^ ... c^. Also, the distance values D^[d] to be used in 
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the correlogram are determined where [d] is the set of 
distances between pixels in the image, and where dmax is the 
maximxjm distance measurement between pixels in the image. In 
Figure 2, an image J. for example, is an n x n matrix {square 
5 for the sake of simplicity) . The distance between pixels Pj 
and Pj, where Pj = (x^, y^) and p, = (Xj, y^) , is 

I p^ - p, I = max{|xi - Xj|, |yi - yj) (1) • 

10 The image I has a set of values of distances between 

pixels Id] . the maximum value of d being the largest distance 
between pixels in the image. 

The color values and distances are used to index the 
correlogram as shown in Figure 1. The value in each entry (c^, 

15 Cj, k) of the correlogram 10, such as the entry (Cj, c^, 3) 15, 
is the probability Pr of finding a pixel of a color value Cj 
at a distance k away from a pixel of color value c^. 

A color autocorrelogram may also be used with the 
concepts of this invention to distinguish an image from other 

20 images. The color autocorrelogram is a restricted version of 
the color correlogram that considers only same-color pairs, 
that is color values of the form (c^, c^) . A comprehensive 
correlogram identification of the image J involves calculating 
correlograins from a number of distances k from the set of [d] 

25 for all of the quantized color pairs (c^, c^) . Experimental 
evidence has indicated, however, that only the 
autocorrelogram, which uses same color-value color-pairs, and 
a few values of k are needed to produce a useful image 
identifier. 

30 The simplified nature of the autocorrelogram facilitates 

a two-dimensional representation which is shown graphically in 
Figure 3 . Figure 3 shows several example autocorrelograms 
where probability is plotted against distance k. The solid 
line 60 in the graph is representative of the autocorrelogram 

35 for a first color value in a first exemplary image. The dot- 
dash line 65 in the graph yields the autocorrelogram for a 
second color in the first exen5>lary image. The dotted line 70 



I 



30 



35 



. WO 99/34319 

8 PCTAJS98/27671 
in the graph gives the altocorrelogram for the first color in 
a se . ^^^^^ _ iaenti^rlr 

thexr correlogram and may be conpared using their 
correlograms . 

method for calculating the color oorrelogram of this 
xnventxon, is to take a first pixel of the color c, in the 

10 pixel L- ^^""-^^ ^"-^ first 

over all of the selected values k in the set of [d] . This 
method takes a long time. .t laj . This 

folio""" "T' correlogram calculation, the 

following algorithm is used. 

/ r ^ " ^'"'""^ as an n X n 0-1 xnatrix such that 

IAp)-1<^I(p) = c. This quantity represents those pixels in the 
xmage of color c. Then the following quantities are defined: 

20 i 

••• KCx-yH- 1) 9 /,|0 < 7 ^ (3 ) 

These quantities count the number of pixels of a given 
color c within a given distance ,c from a fixed pixel (x,y) in 
the posxtxve horizontal and vertical directions 

These expressions, equations 2 and 3. represent a 
restricted count the number of pixels of a particular color 
ZIT ^ ^'^^^ ^ ^rora , .elected Pixel in the 

pos.txve horxzontal and vertical directions instead of all the 

l:\\:t: ^^^^^^ ^^^^^ ^^-^^ 

The method of calculating the colbr correlogram works by 
fxrst computing and where pixel p = (x,y) . 

A(';:„W = >l(t)(*-l) + A^:,,/0) 

with the initial condition 2''''(0) = l if «c= / ^ ^ 

A,p W-i If Pe/e and for each k = 

1 ... d using equation 4. 
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In a similar manner, can also be efficiently 

computed. 

The modulo boundaries are defined as follows: 



(5) 



from which the correlogram entry (c^^Cj^k) can be conputed as 
^c,?c, -^(sfc /Z^^O*)) where fJc, number of pixels of the color 

c^ in the image. 

10 As stated above, the color correlogram and the 

autocorrelogram may be stored in a database and queried in 
order to identify matching images. 

Figure 4 shows a flow chart of the method of this 
invention of image retrieval, using color correlograms, from a 

15 database having stored color correlograms . First, an input 
query image is provided, block 100. The correlogram of the 
input query image is computed, block 110, using one of the 
methods described above, depending on the. type of correlogrfiuns 
stored in the database. Then the correlogram of the input 

20 query image is compared to the correlograms stored in the 
database, block 115. In the present embodiment of the 
invention, the standard norm is used to compare color 
correlograms and color autocorrelograms however any method for 
comparing vectors may be used. The distance, commonly used 

25 to compare vectors, is the sum of absolute differences of the 
components of the vectors being compared. The relative 
distance between two numbers x and y is given by the 
e^^ression |x-y | / (1+x+y) . The relative distance measure 
calculates the sum of the relative differences of the 

30 components of the vectors and in most cases performs better 

than the absolute measure. The resulting distances are sorted 
by increasing order, block 120. Generally, a number of top 
matches is preselected and this nuinber of images are presented 
as an output of images matching the input query image, block 

35 125. 
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The color correlogram may be used to query objects in 
images as well as entire images stored in a database. The 
image subregion querying problem may be defined as follows: 
given as an input a subregion query Q of an image J and an 
5 image set S, retrieve from S those images Q' in which the 

query Q appears according to human perception (denoted O'CO)- 
The set of images might consist of a database of still images, 
or videos, or some combination of both. The problem is made 
even more difficult than image retrieval by a wide variety of 

10 effects on the appearance of an object, such as changing 
viewpoint, camera noise and occlusion, 

A solution to the image subregion querying problem is the 
intersection correlogram. The intersection correlogram is 
defined as the correlogram of the intersection Qf)! . The 

15 color pair co\ant in the nonintersection correlogram is defined 
as: 



Cc.(en/)=^nun{r2;:,/fi).r;;,//)} 



(6) 



Using this the intersection correlogreun is defined as: 

^CrCj^^^^'f H {Qf\l).Sk 

' ' (7) 

The presence of object 0 in J is measured hy the 
distance 

|G-fin/|,,^ (8) 

25 

If Q^I, then the image J should have at least as meiny 
counts of correlating color pairs as the object Q. Thus the 
counts r and H for Qfl/ becomes exactly the correlogram of Q, 
giving |i3~ Gn/|y^^=0 . In other words, where the difference 

30 between the correlogram of the object Q and the intersection 
correlogram of the object Q and the image I is zero, there is 
a match of the object Q with the image J. 
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The distance between Q and Qf]! vanishes when Q is 
actually a subset of j. This affirms the fact that the 
correlogram is a stable property of images. The stability of 
the correlogram, however, is not satisfied by all image 
features. For example, spatial coherence is not preserved 
under subset operations . . 

The color correlogram may also be used to find the 
location of an object in an image. The location problem may 
be defined as follows: given a query image (also called a 
target or a model) £? and an image X such that fie/, find the 
location in j where Q is present. The mathematical location 
is defined at the center of the target for convenience. 

To locate objects in an image, a correlogram 
backprojection is combined with a correlogram correction in 
order to incorporate local spatial correlation information. 
The objective is to integrate discriminating local 
characteristics while avoiding local color template matching. 
To create a color correlogram backprojection, the image and 
the image object are correlogrammed according to the 
principles of the present invention. Then, each color value 
is assigned a frequency value according to how often the color 
value appears in the object versus the background of the image 
xn which the object appears. The frequency values are back- 
projected into the image so that each point in the resulting 
image correlogram has a color- frequency value as well as a 
color value, the color-frequency value representing the degree 
to which a particular color is a useful object indicator. 

A local correlogram contribution is defined by the 
autocorrelogram of the subimage I \, so that the goodness of a 
pixel depends on its position in addition to its color. 

For each pixel p 6 J, the local autocorrelogram «{.*> is 
computed for each distance k e [d] ( [d] should contain only 
small values so that captures local information for each 
pixel) . The contribution of p is the L,-similarity between the 
local autocorrelogram at p and the part of the autocorrelogram 
for Q that corresponds to the color of p. a final goodness 
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value of a subimage I\p, that is the values to be back- 
projected onto the image, is given by the equation 

where 0 < P £ 1. 

5 The correlogram contribution to correlogram correction 

by itself is sensitive and may in some cases overemphasize 
less dominant colors. is defined as a less dominemt color, 

e.g. the background color, that has a high autocorrelogram. 
If image J has a subimage l|p (which may be totally irrelevant 

10 to object C?) that has many pixels of color Cj, with high 

autocorrelations, then the correlogram backpr ejection has a 
tendency to identify Q with J|p thus causing an error. Because 
the problems with histograms and correlograms are somewhat 
coir^lementary to each other, the best results are obtained 

15 when the goodness of a pixel is given by a weighted linear 
combination of the histogram and correlogram backpr ejection 
contributions. This is called a correlogram correction. The 
color histogram is known in the art. The best weight can be 
determined by experimental means and is dependent on the 

20 particular application emd the database being used. 

The increasing availability of video data makes automated 
video analysis a necessity. The step to automate video 
content analysis is to segment a video into camera shots (also 
known as key frame extraction) . A camera shot is an unbroken 

25 sequence of frames from one camera and a cut is said to occur 
when two consecutive frames are from different shots. 

Cut detection algorithms usually work as follows: 
adjacent frames are compared using some image feature and 
frames that are sufficiently similar are assiomed to belong to 

30 the same shot, and dissimilar frames are taken to signify a 
cut. Different cut detectors use different features to 
compute the similarity between consecutive frames, e.g. pixel 
difference, statistical differences, histogram comparisons, 
edge differences. Correlograms have been shown to be robust 

35 to large appearance changes for image retrieval and 
correlograms are used for cut detection. 



f 
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In a sequence of video frames that have some number of 
cuts in the sequence, a pair of adjacent images are evaluated 
using color correlograms using a preselected feature f to 
determine if the cut occurs between the two images/ If the 
5 frames do not match according to the feature f , then the cut 
does occur between the txyo adjacent images. 

It is to be understood that the above-described 
embodiments are simply illustrative of the principles of the 
invention. Various and other modifications and changes may be 
10 made by those skilled in the art which will embody the 

principles of the invention and fall within the spirit and 
scope thereof : 

. . . ■ y*: i 

what is claimed is: 
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1. A computer-implemented method for retrieving an image 
object from a plurality of images, comprising the steps of: 

5 providing an image object color correlogram; 

providing a plurality of color values; 
selecting a distance value to be used as the distance 
between pixels, in the image object and in the plurality of 
images, to be evaluated for color value; 
10 analyzing said image object according to said color 

values and said selected distance value; 

determining in response to the analyzing step a 
probability of finding a pixel of a particular color value at 
said distance value from a pre-selected pixel of a pre- 
15 selected color value; 

entering said probability into the image object color 
correlogram; 

providing color correlograms for each of said plurality 
of images; and 

20 intersecting the image object color correlogrsun with 

correlograms of the plurality of images to produce an 
intersection result, 

wherein the image object is distinguished by . the 
intersection result from the images which do not contain the 

25 image object. 

2 . The method of claim 1 wherein the intersecting step 
further comprises comparing a count of a first plurality of 
color pairs in the image object with a count of a second 

30 plurality of color pairs in the image, the first plurality of 
color pairs correlating to the second plurality of color 
pairs . 

3 • The method of claim 1 wherein the step of providing color 
35 correlograms for each of said plurality of images further 
comprises storing the provided correlograms in a database. 
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4. The method of claim 1 further comprising the steps of: 

selecting a plurality of distance values; and 
performing said analyzing step, said determining step and 
said entering step using said plurality of distance values. 

5 

5. A system for retrieving an image object from a plurality 
of images, comprising: 

means for providing an image object color correlogram; 
means for providing a plurality of color values; 
10 means for selecting a distance value to be used as the 

distance between pixels to be evaluated for color value in the 
image object and in the plurality of images; 

means for analyzing said image object according to said 
color values and said selected distance value; 
15 means for determining in response to said means for 

analyzing, a probability of finding a pixel of a particular 
color value at said distance value from a pre-selected pixel 
of a pre-selected color value; 

means for entering said probability into said image 
20 object color correlogram; 

means for providing color correlograms for each of said 

plurality of images; and 

means for intersecting said image object color 
correlogram with correlograms of the plurality of images to 
25 produce an intersection result, 

wherein the image object is distinguished from the images, 
which do not contain the image object by the intersection 
result . 

30 6 . The system of claim 1 wherein said means for intersecting 
further comprises a means for coirparing a count of a first 
plurality of color pairs in the image object with a count of a 
second plurality of color pairs in the image, the first 
plurality of color pairs correlating to the second plurality 

35 of color pairs. 
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7. The system of claim 1 further comprising a database for 
storing said provided correlograms of s^id plurality of 
images . 

5 8. The system of claim 1 further comprising: 

means for selecting a plurality of distance values; 
means for analyzing said image object and said plurality 
of images according to said color values and said plurality of 

distance values; and 
10 means for determining, in response to said analyzing 

means, a probability of finding a pixel of a particular color 
value for each of said plurality of distance values from a 
selected pixel of a selected color value. 

15 9. A computer- in^lemented method of locating an image object 
in an image comprising the steps of: 

providing a plurality of color values and at least one 

distance value; 

computing a color correlogram for the image object using 
20 the plurality of color values and the at least one distance 
value ; 

computing a color correlogram for the image using the 
plurality of color values and the at least one distance value; 
analyzing the image object and the image to determine a 
25 color frequency value for each color value; 

assigning the color- frequency value to each pixel in the 
image object to make a back-projection image object 

correlogram; eind 

combining the back-projection image. object correlogram 
30 with the image correlogram to create a correlogram 

backprojection indicating the location of the image object in 
the image. 



10- The method of claim 9 wherein 
35 said step of confuting the image object color correlogram 

further comprises computing an autocorrelogram for the image 
ob j ect ; euid 
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said step of cpmputing the image color correlogram further 
comprises computing an autocorrelogram for the image. 

11. The method of claim 9 further comprising the step of: 
locating the image object by the mathematical center of the 

image ob j ect . 

12. The method of claim 9 further comprising the step of: 
combining the back-projection image object correlogram 

with a color histogram of the image object to obtain 
correction values ; and 

combining the correction values with the color 
correlogram of the image to accurately locate the image 
obj ect . 



13 . The method of claim 12 further comprising the step of 
weighting the values of the back-projection image object 
correlogram and weighting the values of the color histogram to 
produce weighted correction values to be combined with the 

20 color correlogram of the image. 

14. A system for locating an image object in an image, 
comprising: 

means for providing a plurality of color values and at 
25 least one distance value; 

means for computing a color correlogram for the image 
object using the plurality of color values and the at least 
one distance value; 

means for computing a color correlogram for the image 
30 using the plurality of color values and the at least one 
distance value; 

means for analyzing the image object and the image to 
determine a color frequency value for each color value; 
means for assigning the color-frequency value to each 
35 pixel in the image object to make a back-projection image 
object correlogram; stnd 

means for combining the back-projection image object 



1 
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correlogram with the image correlogreun to create a correlogram 
backprojection indicating the location of the image object in 
the image. 

5 15. The system of claim 14 wherein 

said means for computing the image object color 
correlogram further comprises means for computing an 
autocorrelogram for the image object; and 

said means for computing the image color correlogram 
10 further comprises means for computing an autocorrelogram for 
the image. 

16. The system of claim 14 further comprising: 

means for combining the back-projection image object 
15 correlogram with a color histogram of the image object to 
obtain correction values; and 

means for combining the correction values with the color 
correlogram of the image to accurately locate the image 
obj ect . 

20 

17. The system of claim 16 further comprising: 

means for weighting the values of the back-projection 
image object correlogram; 

means for weighting the values of the color histogram to 
25 produce weighted correction values to be combined with the 
color correlogram of the image. 

18 . A method for detecting cuts in a sequence of video frames 
comprising the steps of: 

30 providing an image object; 

computing a color correlogram of the image object; 
confuting a color correlogram of a first video frame; 
intersecting the image object color correlogram with the 
first video frame color correlogram to obtain a first result 
35 determining the presence or absence of the image object in the 
first video frame; 
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computing a color correlogram of a second video frame, 
the second video frame being adjacent to the first video frame 
in the sequence of video frames ; 

intersecting the image object color correlogram with the 
5 second video frame color correlogram to obtain a second result 
determining the presence or absence of the image object in the 
second video frame; and, 

comparing the first result with the second result in 
order to determine a cut between the first video frame and the 

10 second video frame, 

wherein a cut occurs where the image object is present 
■ in one of the adjacent video frames and not present in the 
other adjacent video frame. 
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